Description

Refactor report aggregation from "nested E2E tests" results: use JS code to aggregate JSON reports from Ginkgo instead of shell-based XML reports aggregation. JS code is more maintainable and covered with unit tests.

The change introduces two public report entrypoints:

• cluster-report.js, which builds one comprehensive e2e_report_<storage>.json artifact per cluster from workflow stage results and an optional raw Ginkgo JSON report;
• messenger-report.js, which reads the generated cluster artifacts, renders the consolidated nested-cluster E2E summary, and optionally publishes the main message and failed-tests thread to Loop.

Supporting code is split by responsibility under report/shared/ and report/messenger/ so the workflow-facing entrypoints stay easy to find while the implementation remains modular.

The reusable pipeline now passes report configuration explicitly to the cluster report builder, uploads final report artifacts with overwrite enabled for job reruns, and keeps the final report contract self-contained. The matrix workflow downloads those final artifacts and no longer relies on hardcoded fallback environment variables to reconstruct cluster state.

Additional unit tests, linting configuration, JSDoc annotations, and local report wrappers were added or updated for the new reporting flow.

Why do we need it, and what problem does it solve?

The previous implementation built E2E summaries with large inline shell scripts in workflows. That approach was hard to maintain, hard to test, and fragile when artifacts were missing or when failures happened before the E2E stage.

This change moves the reporting flow into tested JavaScript modules and uses a single final JSON report per cluster as the contract between workflow stages. That makes report generation easier to validate, easier to evolve, and less dependent on brittle shell parsing.

It also improves failure handling by preserving cluster setup status separately from E2E test status, distinguishing test failures from setup failures, supporting missing or invalid Ginkgo reports explicitly, and deriving failed-test metrics from the parsed Ginkgo JSON report.

As a result, nested-cluster E2E reporting becomes more reliable and maintainable for successful runs, failed runs, cancelled runs, and rerun test jobs.

What is the expected result?

1. Run the nested E2E workflows for configured storage types.
2. The reusable pipeline uploads the raw Ginkgo report when available and produces a final structured e2e_report_<storage>.json artifact for each cluster.
3. Each final cluster artifact contains clusterStatus, testStatus, metrics, failed tests, branch metadata, and workflow run links.
4. The matrix workflow downloads the final cluster artifacts and renders a consolidated summary.
5. The summary message contains:
   • a test results table for clusters with E2E test results;
   • a separate cluster failures section for setup-stage failures;
   • a missing reports section when final report artifacts or Ginkgo reports are unavailable;
   • a failed-tests thread when testcase-level failures are available.
6. If Loop credentials are configured, both the main message and the thread replies are sent through the Loop API.

Checklist

• The code is covered by unit tests.
• e2e tests passed.
• Documentation updated according to the changes.
• Changes were tested in the Kubernetes cluster manually.

Changelog entries

section: ci
type: fix
summary: "Refactor nested E2E report generation into tested Node.js scripts with JSON reports and improve Loop reporting for missing artifacts, skipped tests, and stage failures."
impact_level: low